Spectral Coarse Graining and Synchronization in Oscillator Networks 
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Coarse graining techniques offer a promising alternative to large-scale simulations of complex 
dynamical systems, as long as the coarse-grained system is truly representative of the initial one. 
Here, we investigate how the dynamical properties of oscillator networks are affected when some 
nodes are merged together to form a coarse-grained network. Moreover, we show that there exists a 
way of grouping nodes preserving as much as possible some crucial aspects of the network dynamics. 
This coarse graining approach provides a useful method to simplify complex oscillator networks, and 
more generally any network whose dynamics involves a Laplacian matrix. 
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Dynamical systems of coupled oscillators have been of- 
ten used to describe several natural phenomena in various 
fields of science ranging from cardiology to ecology [![. 
In particular, the emergence of synchronization has re- 
ceived much attention. Historically, the first results have 
been obtained considering some particular system archi- 
tecture 0, 0]. More recently, synchronization has been 
studied for arbitrary coupling given by the topology of 
complex networks [j, [a S H] • 

Unfortunately, for large dynamical systems of inter- 
acting units such as cardiac cells synchronizing in the 
heart or Malaysian fireflies flashing in unison |l[ , consid- 
ering the full network often results in a very large number 
of coupled differential equations. In such cases, the use 
of coarse-grained models is key to reducing the system 
complexity, and a crucial issue is to know how we should 
formulate the coarse-grained model and its dynamics . 

A common approach is to consider some units of the 
system as almost indistinguishable and to merge them 
into one single node, giving rise to the concept of meta- 
populations [10 ]. Most often, prior information about the 
nature of the nodes has been used to decide which ones 
should be merged. However, some attempts can be found 
to define automated procedures depending only on the 
information given by the network itself. In particular, 
it has been shown recently that one can merge nodes 
so that the properties of random walks on the network 
are almost left unchanged ll|, 12, 13j]. Mathematically, 
this was expressed as the possibility of preserving some 
eigenvalues of the stochastic matrix. Merging nodes is 
also related to the problem of finding clusters in networks 
see for instance [l4, 15, 1(| for popular algorithms, or [f| 



171 . [18| for methods based on network synchronization) . 



However, the first aim of clustering techniques is rather 
to classify the nodes into communities and not to build 
a coarse-grained model of a network. 

In this Letter, we investigate how the dynamics of cou- 
pled oscillator networks, and especially synchronization 
patterns, is affected by merging some nodes together. In 



particular, we show that the method of 13j, referred to 
as Spectral Coarse Graining (SCG), can be extended to 
provide a natural framework for coarse graining oscillator 
networks preserving some of their dynamical properties. 

We consider a system of N identical oscillators with a 
coupling given by the topology of an undirected network. 
Most often the coupling involves the Laplacian L, which 
is defined as L lj = -Wji if i ^ j and L u = Yj&Liji 
where Wji stands for the weight of the edge from node j 
to node i. We briefly recall that all rows of L sum up to 
(y~]j Lij = 0) , which implies that there is an eigenvalue 
A 1 = with a corresponding constant eigenvector p 1 . 
Moreover, for undirected and connected networks, the 
eigenvalues of L are all real and satisfy = A 1 < A 2 < 
. . . < A^. These eigenvalues play a critical role in the 
dynamics of oscillator networks, as we will see below. 

Our first example of oscillator network dynamics falls 
in the general framework of : 



N 

Xi = F(xi) +<t^L ij H{k, j ) 1 



(1) 



with Xi G R d . ^(x) accounts for the internal dynamics of 
each node, H (x) is a coupling function and a is the cou- 
pling strength. In this case, the eigenvalues of L appear 
naturally in the analysis of the stability of the synchro- 
nized state (xi(t) = s(t), Vi, Vi), as it was shown in the 
seminal work of Ref. [3(. There, the authors have proved 
that the linear stability of this state is described by the 
variational equation ^ = Z?F(s)£,; + I j ijDH{s)£ i i, 
which can be diagonalized into: 

C = DF(s)C + <T\ a DH(s)C, a = 1, . . . , N. 

The synchronized state (a — 1) is linearly stable if all 
Lyapunov exponents are negative for a — 2, . . . , N. In- 
terestingly, in several cases, such as the Rossler oscilla- 
tors there exists a single range of values l\ < a\ a < 
h, a — 2, . . . , N such that the synchronized state is lin- 
early stable. As a consequence, the network can be syn- 
chronized if and only if X N /X 2 < I 2 /I 1 = (5 



Other dynamical processes have also been investigated 
to study synchronization in networks, such as the Ku- 
ramoto model @]: 

ij = uij + a Ajj sin(xj — Xj). (2) 

j 

Here Aij stands for the adjacency matrix of the net- 
work. Close to the synchronized state (xi — Xj) and 
considering identical oscillators (uii — u, Vi) as in 
the linearized dynamics is given by x = il — crix, with 
Q = (cji, . . . ,ujn) T - In this case the synchronized state 
is always stable and the eigenvalues of L describe the 
behavior of the normal modes of the linearized dynam- 
ics 0- 

Overall, the two dynamical systems described above 
show that the eigenvalues of L play a crucial role in the 
dynamics of oscillator networks. It is therefore extremely 
important to know how these eigenvalues are affected 
when some nodes are merged. Besides, one should try 
to preserve their value as much as possible. The coarse 
graining strategy introduced in this Letter shows that 
this goal can be reached in many cases. 

To define properly a coarse graining strategy, two ques- 
tions need to be answered. First, how should we merge 
nodes and update the edges in oscillator networks, so that 
the resulting network is truly representative of the initial 
one? Second, which nodes should be merged? The first 
question, though less important if one is only interested 
in identifying groups of nodes in a network, is crucial 
to build a coarse-grained network in which each node 
has similar dynamical properties as the initial nodes it 
is made of. For simplicity, we first consider the exam- 
ple of the small network of Figured] (a)- Let us assume 
we have decided to merge the two square nodes. Then 
the edges in the reduced network should be drawn as 
in Figure [T] (b) . Indeed, since each of both circle nodes 
connected to the square nodes in (a) receives two edges 
from them, an edge with weight equal to two needs to be 
drawn in the reduced network. On the other hand, we 
want the square node in the reduced network of (b) to 
exhibit a behavior corresponding to the one of the two 
square nodes in the initial network. Since each of these 
two nodes receives only one edge from each circle node, 
an edge with weight equal to one is drawn in the network 
of Figure Q](b). 

More generally, the weight of the edges should first be 
added for each group. Then, to preserve the structure of 
equation (TJ or the weight of incoming edges should 
be divided by the size of the group they are pointing 
to, as in Figure Q] (b) and (c). Interestingly, if the re- 
sulting network is made up of N nodes corresponding to 
N groups in the initial network, the Laplacian L of the 
reduced network can be expressed as a matrix product 

L = KLR. (3) 
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(a) (b) (c) 




A. 2 =0.1350 X 2 =0.1350 X 2 =0.1352 



FIG. 1: (Color online) (a) Small toy network, (b) Coarse- 
grained network in which the two square nodes have been 
merged, (c) Coarse-grained network in which the three dia- 
mond nodes have further been merged. Numbers on the edges 
indicate the weight of the edges that have been updated in 
the coarse graining. The smallest non-trivial eigenvalue of L, 
A 2 , is displayed for each network. 



K £ R and R £ K are two rectangular matrices 
defined as follows. If nodes are labeled with i = 1, ... N 
and groups are labeled with C — 1,...,N, then 

K C i = Scd and R C i = Sec, , (4) 

where \C\ is the cardinality of group C, Cj is the label of 
the group of node i, and 5 is the usual Kronecker symbol. 
Therefore, the C th row of R (column of K) has non-zero 
elements only for the entries corresponding to the nodes 
in group C. Equations ^ and (H]) define the central 
matrix transformation for the Spectral Coarse Graining 
(SCG) of L. We note that the rows of L sum up to zero 
for any kind of grouping, which means that L always has 
the properties of a Laplacian. Having found how edges 
are to be updated when nodes are merged, we still have 
to know which nodes should be merged. 

This question can be answered by observing that equa- 
tions © is very similar the one used in Ref. [l3| for the 
SCG of stochastic matrices 24]. In particular, we have 
the property that RK is block diagonal (up to an ap- 
propriate reshuffling of the rows and columns) with each 
block corresponding to a group of nodes, and that all en- 
tries within a block are equal to the inverse of the group 
size. This means that if groups are formed such that the 
components of an eigenvector p a of L are equal within 
each group, then RKp a — p a , which implies that the re- 
duced vector Kp a is an eigenvector of L with eigenvalue 
A Q (LKp a = KLRKp a = X a Kp a ). Therefore, merg- 
ing nodes with the same components in p a preserves the 
eigenvalue A" of L, i.e. A" is also an eigenvalue of L. 
This property defines the exact SCG of L. The equality 
between eigenvector components is for instance encoun- 
tered if some nodes have exactly the same neighbors, as 
the two square nodes in Figure [T] (a) [25| . 
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Furthermore, the perturbation approach outlined 



in [13J for stochastic matrices applies as well to the SCG 
of L. If two nodes i and j having almost the same eigen- 
vector components in p a are merged, the new Lapla- 
cian L has an eigenvalue A Q almost equal to A Q . In 
this case, the SCG is said to be approximate. Mathe- 
matically, the fact nodes i and j have almost the same 
eigenvector components can be expressed for instance as 

d i,j = W -Pj l/bmax -Pmin) « 1 for a S iven wh ere 

Pmax (Pmin) are the largest (smallest) components of p a . 
In practice, the condition <C 1 can be implemented by 
defining / equally distributed intervals between p" lin and 
Pmax an d grouping the nodes whose eigenvector compo- 
nents in p a fall in the same interval. 

In Figure [TJ we provide an example of the two kinds of 
SCG considering the eigenvector p 2 . On the one hand, 
the two square nodes in Figure have exactly the same 
eigenvector components in p 2 and the eigenvalue A 2 is 
exactly preserved in the network of Figure [T] (b). On 
the other hand, the components in p 2 of the three nodes 
shown with blue diamonds in Figure [T] (b) are very close 
to each other (all d 2 j are smaller than 0.02) and the 
eigenvalue A 2 is almost preserved in the network of Fig- 
ure Q] (c). This shows that SCG is indeed not restricted 
to the special case in which eigenvector components are 
equal, but applies also when components are close to each 
other. Finally, we note that SCG can be readily extended 
to preserve more than one eigenvalue by merging nodes 
that have almost the same components within each cor- 
responding eigenvector. 

To illustrate the effect of SCG on the synchronization 
patterns in large oscillator networks, we first consider 
the dynamics of Rossler oscillators [19( with ^-coupling 
[F{x, y, z) = (—y — z, x + ay, b + z(x — c)), with a = b = 
0.2 and c = 7, H(x,y,z) = x\. In this case, the stabil- 
ity of the synchronized state is given by the condition 
X N /\ 2 < (3 w 37.85 0. The behavior of X N /X 2 has al- 
ready been studied in several kinds of networks @, 0, Q . 
Here, instead, we investigate how X N /A 2 changes when 
some nodes are merged. In Figure [2] (a) and (b), we first 
show our results for two generic networks: a Barabasi- 
Albert (BA) and a small- world (SW) network [H|. 



Stars correspond to a random merging of the nodes into 
N groups, while circles show the results of SCG per- 
formed along both p 2 and p , i.e, groups are made up 
of nodes with d 2 4 <C 1 and d^ <C 1. In the latter case, 
the different values of N correspond to different choices 
of the number of intervals I defined between the smallest 
and the largest component in the eigenvectors p 2 and p N 
(the smaller /, the smaller N). Both eigenvalues A 2 and 
X N are well preserved in the network obtained with SCG 
even when the size is strongly reduced. A similar analy- 
sis was carried out in Figure [2] (c) for a real network of 
N = 185 nodes diplayed in Figure (d). The network 
was originally built from a synonymy relationship be- 
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FIG. 2: (Color online) (a)-(c) Evolution of the ratio X N /X 2 as 
a function of the size of the coarse-grained network. Red stars 
correspond to a random merging of the nodes; green circles 
correspond to the SCG using both p 2 and p N . The black 
line shows the critical value j3 — 37.85. (a) SW network [2l| ]. 
N = 1000, p = 0.05. (b) BA network [20], N = 1005, m = 
2. (c) Network displayed in (d). (d) Sub-component of a 
synonymy network (iV=185). Colors were set only to help for 
comparison with Figure [3] (a) . 



tween words and the graph displayed in Figure [5] (d) cor- 
responds to one of the disconnected sub-components . 
This network exhibits clearly a heterogeneous internal 
structure, which makes it particularly interesting to il- 
lustrate a coarse graining procedure. 

Figure [2] clearly shows that, if nodes are merged ran- 
domly, the ratio A 2 and A w changes dramatically. On the 
other hand, the nature of the synchronized state is pre- 
served much longer if groups are formed using the SCG 
along both p 2 and p N . 

Let us now consider the Kuramoto model of equa- 
tion @ . We have seen that the lowest eigenvalues of L 
describe the slow modes of the system close to the syn- 
chronized state. Thus one should try to preserve these 
eigenvalues in a coarse-grained network. In Figure [3] (a), 
we have built a coarse-grained version the network of 
Figure [5] (d). This coarse-grained network was obtained 
by SCG considering the two lowest non-zero eigenvalues 
of L, A 2 = 0.0081 and A 3 = 0.016. Along each of the 
corresponding eigenvectors p 2 and p 3 , we have defined 
/ = 40 intervals equally distributed between the small- 
est and largest eigenvector component. We have grouped 
nodes that fall in the same interval for each eigenvector. 

The two eigenvalues of L are well preserved in the new 
Laplacian L: X 2 = 0.0083 and A 3 = 0.017. To compare 
the dynamics defined by the non-linearized equation @ 
in the two networks, we display in Figure [31(b) the tern- 
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cian of a network. 

Finally, with a view to enhancing synchronizability [3, 
[B|, @ instead of preserving the dynamics, SCG may be 
useful to decide which nodes should be merged such that 
the ratio X N /X 2 displays the steepest decrease with N. 
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FIG. 3: (Color online) (a) Coarse-grained version (iV=27) of 
the network in Figure [2] (d) . The node size is proportional to 
the size of the corresponding groups. The node color in the 
coarse-grained network corresponds to the color of the nodes 
in the initial network (in Figure [2] (d) colors were chosen such 
that each group is made up of nodes of only one color), (b) 
Temporal evolution of 1 — (r(t)) according to equation [2] in 
the initial network of Figure [2] (continuous line) and in the 
coarse-grained network displayed in (a) (circles), a = 1. 



poral evolution of the order parameter [2 



1 

1/2, 



(r(t)> = 

(Ei cos ( a; i(*))) 1S + (Ei sm ( a; i(*))) 1! J )' where 

the average is taken over a set of 200 randomly cho- 
sen initial conditions. The synchronized state (given by 
l — r(t) =0) is reached in a very similar way in both net- 
works, which allows to conclude that the coarse-grained 
network is representative of the initial one from the point 
of view of the synchronization. We also observe that in 
this case, the coarse-grained network of Figure [3] (a) can 
be interpreted as a backbone structure of the initial net- 
work. 

Summarizing, we have investigated how synchroniza- 
tion in oscillator networks behaves when some nodes are 
merged together. For this purpose, we have introduced 
a Spectral Coarse Graining technique for the Laplacian 
matrix, which allowed us to know both how nodes should 
be merged, and which nodes should be merged in oscil- 
lator networks. This technique requires only the com- 
putation of a few selected eigenvalues and eigenvectors, 
and was shown to preserve some crucial aspects of the 
network dynamics. For instance in the case of Rossler 
oscillators, the key parameter is the ratio A N /A 2 and our 
results show that SCG allows to reduce significantly the 
network size while keeping X N /A 2 close to its initial value, 
whereas random merging of the nodes had dramatics ef- 
fects on X N /A 2 . Considering the dynamics of the Ku- 
ramoto model, we have shown that the behavior of the 
system close to the synchronized state can be preserved 
by preserving the first eigenvalues of L. More generally, 
we believe that SCG provides an appropriate mathemati- 
cal framework to simplify a variety of dynamical systems 
whose dynamics involves a coupling given by the Lapla- 
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